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A method for the ani-r)Tn;:ii-<ad analysis of a mobile radio 



Technical field 

The invention relates to a method for the automated 
analysis of a mobile radio telephone system, in which 
method a multiplicity of test connections are 
established between two terminals, particularly a 
mobile terminal and a stationary or mobile terminal, as 
part of a test phase, and a plurality of protocol 
parameter values are acquired during the test phase. 

Prior art 

The providers of mobile telecommunication are 
increasingly exposed to competition. There is a 
corresponding need to control and, if possible, to 
improve the quality of their , own mobile radio telephone 
system. On the one hand, this involves opening up new 
geographic regions as efficiently as possible (i.e. at 
low cost but with area-wide coverage) in order to 
increase the potential of interested parties in this 
way. On the other hand, the existing customers should 
be kept by means of high quality of the network. 

From the point of view of the user, the quality of the 
mobile radio telephone system is judged on the 
transmission quality of the voice, the availability of 
the network access, the frequency of call interruptions 
etc., i.e. the user wishes to be able to telephone at 
any time and to have a good and uninterrupted 
connection independently of his location and the 
duration of the call. 



telephone system 



Mobile radio telephone systems are highly complex 
technically. Their performance depends on boundary 
conditions which vary with time and in some cases can 
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only be calculated with difficulty or not at all. In 
addition, a mobile radio telephone system must be 
continually adapted to the current needs (e.g. by 
integrating more base stations) . Faults, and weak points 
5 in the system must be localized step by step and the 
causes must be eliminated. However, the operator of the 
mobile radio telephone system cannot rely on the 
reports from the subscribers. They will scarcely take 
the trouble to point out possible weak points to the 

10 system operator in a consistent and logical manner. 
Even if the operator were to be informed in this way, 
these reports would only in exceptional cases be 
suitable for locating a system fault. There would be 
too little information available about the system state 

15 which could have caused the fault which led to the 
complaint . 

Today, system analysis and optimization must be 
performed in painstaking and detailed work by experts. 
20 The problem is that errors in system programming, 
malfunctions of the hardware and design faults in the 
network planning have effects on the subjectively 
perceived network quality which are difficult to 
predict. 

25 

In the known manual analysis, many test connections are 
established and assessed with respect to quality. To be 
able to locate any disturbances in the system, protocol 
data are recorded and stored. Such test runs are 
30 performed periodically in most cases. The test duration 
can be selected arbitrarily and thus an enormous effort 
must be made not only in collecting the test data but 
also in evaluating the collected data. 

35 If it is considered that typically far more than 100 
protocol values are produced per second, it becomes 
clear how much effort is required to check all these 
values manually and to locate possible system faults 
(which - as already mentioned - are not necessarily 
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apparent directly from the protocol values) . There is 
no question of a systematic system analysis . 

In WO 93/15591, a method for planning a cellular radio 
telephone network is described. The planning is done on 
the basis of a model of the radio environment and of a 
simulation of the system. The aim of the simulation is 
to generate the data required for the subsequent 
analysis. It should also be possible to apply the 
optimization of the system parameters to existing 
systems and the parameters are thien measured. As part 
of the evaluation, individual parameters are 
graphically displayed on a screen as a function of 
other parameters. 

Description of the invention 

It is the object of the invention to specify a method 
of the type initially mentioned which provides for the 
automated analysis and assessment of the quality of a 
mobile radio telephone system. 

The features of claim 1 define how this object is 
achieved. The method accordingly comprises the 
following steps: 

a) A multiplicity of test connections is 



considered to be established not only when it 

is set up and dropped again (properly or due to 

faults) but also if it is not established in 

spite of an attempt (is unsuccessful, as it 
were) . 



established between two terminals (particularly 
a mobile terminal and a stationary terminal or 
two mobile terminals) with the aid of a test 
and measuring device as part of a test phase. 
In this context, a test connection is 



b) During the test phase, the values of a 
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plurality of protocol parameters internal and 
external to the system are acquired and 
recorded. For example, the parameter values of 
the various system units are acquired 
5 separately during the data acquisition. System 

units are understood to be functional units 
(hardware components or also program units) of 
the mobile radio telephone system and of the 
measuring device (e.g. various layers in the 
10 terminals, switching units and other components 

of the base stations, etc.). 

c) From these protocol parameter values, records 
are generated which are stored in real time or 

15 off-line in a database. The database has a 

suitable structure so that it is possible to 
search for all protocol parameter values 
selected in the sense of the subsequent method 
steps. 

20 

d) The protocol parameters are evaluated in each 
case separately with regard to a certain 
assessment criterion with a separate module, 
the number of such modules being greater than 

25 or equal to one and freely selectable. In most 

cases, a number of such modules is provided. 
These assessment criteria can be, for example, 
the type of call end, the speech quality or the 
degree of coverage in the coverage area. The 

30 corresponding evaluation modules for the 

assessment criteria mentioned are then called, 
e.g., "call end analysis", "speech quality 
analysis" and "coverage analysis". 

35 e) Each module calculates a quality value - the 

module quality value - of the mobile radio 
telephone system. For this purpose, a further 
quality value - the event quality value - is 
determined for a number of event types which 
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are of significance for this assessment 
criterion. The number of events taken into 
consideration per module and also the number of 
parameters taken into consideration per event 
5 is at least one, but can be expanded 

arbitrarily. The module quality value is then 
calculated as the mean value of the various 
event quality values. 



10 f) To obtain a quality value for the overall 

system, a system quality value is calculated 
from the various module quality values. It then 
becomes possible to subject the system to an 
accurate analysis in order to analyze and to 

15 assess, for example, the speech quality of the 

mobile radio telephone system. 

The core, of the invention lies in the fact that the 
quality of various parts and subsystems of the mobile 

20 radio telephone system is systematically determined. 
Systematically here means that a predetermined list of 
parameters and parameter sequences to be tested is 
completely processed. However, it means not only the 
quality of individual parameter values which are not 

25 within the prescribed interval and may not even lead to 
a fault but also that of entire system sequences, 
situations or circumstances which could result in 
system errors . 

30 The essential advantage of the invention lies in the 
combination of systems and speed of analysis. Due to 
the enormous volume of data, technical experts would 
not only look for weeks but would also frequently 
become stuck because the search system cannot be 

35 guaranteed or only with disproportionately great 
expenditure. 

Moreover, in contrast to the prior art, it is not only 
individual parameter values which are examined for 
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correctness in the invention but entire sequences and 
the behavior of entire system parts or components can 
.be analyzed. This makes it possible to better detect 
relationships and if possible to intervene more rapidly 
5 and more selectively. The system analysis is of modular 
configuration which makes the method extremely flexible 
and allows the system to be examined and to be assessed 
in every detail. If it is required, the system analysis 
can also be followed by an automated fault correction, 
10 naturally. 

The internal system protocol parameters mainly consist 
of signaling messages which occur in the terminals or 
in the network (e.g. data which are generated by the 

15 existing control hardware or software of the system 
during a call and are used for controlling and 
monitoring the communication link) . The external system 
protocol parameters are mainly information which is 
typically determined periodically or, if required, also 

20 by means of separate measuring and analysis methods in 
the terminals or distributed in the network (such as, 
e.g., data for assessing the quality of the connection, 
boundary information data on location, time, speed etc. 
of the mobile terminal) . 

25 

Each record thus determined is provided with a time 
stamp and allocated to a particular group of data on 
the basis of a grouping criterion (in most cases 
allocated to a protocol parameter) . A grouping 
30 criterion can be, e.g., the base station, the 
geographic position (e.g. at 100 m) , the frequency 
channel or also the network operator. The data are 
stored in a database having a suitable structure. 

35 The time stamp of the actual data acquisition and 
preferably another parameter, the identifier of the 
connection, are used for synchronizing the data when 
they are input into the database. (The identifier is of 
importance especially if, in addition to the test 
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connections, other user connections are also running 
via a particular unit, e.g. via a base station.) 

In a preprocessing step, the records can already be 
grouped in accordance with a required grouping 
criterion as far as possible so that they can be 
processed better and more rapidly later. At the same 
time, the data reduction can also be performed. 



Firstly, at least one event table per module is 
generated from the records stored in the database by 
searching the database for predetermined protocol 
parameter values or for certain combinations of 
protocol parameter values which signal a predefined 
event. The corresponding records (or, respectively, the 
protocol parameters contained in them) are then stored 
wholly or partially in the event tables. 

For each- event thus found, the exact time is determined 
at which it has taken place. After that, a selectable 
or predefined leading and/or trailing time is 
determined before or after the event, respectively, 
which identifies the period within which other relevant 
events are located which influence the event found or 
can be influenced by it. 



The relevant data of the relevant events located within 
this leading or trailing time are also picked out of 
the database and are entered in the event table 
together with the data of the events found. Each event 
found is classified by means of these data. The events 
are classified because an event X which proceeds, e.g., 
event A is "normal" whereas event X which is preceded 
by event B characterizes a fault and, accordingly, must 
be processed differently. 



Once the events have been allocated to the 
classes, a quality value - the event quality 
determined for each possible event type or 



respective 
value - is 
event type 
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which has occurred within the observation period. 

a) For this purpose, a numerical value is firstly 
allocated to each possible signaling message or 

5 ' sequence. This mapping of the messages into the 

numerical domain takes place in order to obtain 
a possibility for quantitative assessment of 
the circumstances before and after a certain 
event . 

10 

b) After that, an average record is calculated 
from the records of all events with the same 
classification and from these numerical values, 
in each case forming the mean value of the same 

15 protocol parameters of each data record or, 

2:espectively, of the numerical values for the 
signaling sequences . 

c) Using these mean values as components, an event 
20 vector is formed for each possible event type 

(if at least one event of this type has 
occurred) . 

d) The event quality value is now determined by 
25 scalar multiplication of the event vector of a 

certain event type by a weighting vector which 
corresponds to the event type, i.e. is 
event-specific. This weighting vector is 
necessary since not all protocol parameters of 

30 the event vector have the same amount of 

influence or the same degree of significance 
for this event type. The sum of the weighting 
factors of the individual event weighting 
vectors is preferably equal to one so that, at 

35 the same time, a certain normalization can also 

be achieved. 

Finally, a system quality value with respect to a 
selectable grouping criterion is also calculated from 
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the individual module quality values. For this purpose, 
a quality vector is formed, the components of which are 
the module quality values of the individual modules. 
The system quality value is now calculated as the 
5 scalar product of this vector by a module weighting 
vector which weights the individual modules in 
dependence on the selected grouping criterion. The sum 
of the components of the module weighting vector is one 
which also makes it possible to achieve a normalization 
10 of the system quality value. This produces a system 
quality value for each possible value of the grouping 
criterion, i.e. exactly one system quality value for 
each base station, each geographic position, each 
frequency channel or each network operator. 

15 

It is thus possible to perform an evaluation of the 
acquired data which is flexible, conforms to detail and 
has any degree of accuracy by suitably selecting the 
event-specific vectors and the module weighting 
20 vectors. For example, it is possible to analyze the 
speech qualities of the connections of a particular 
base station in dependence on the terminal position or 
in dependence on the frequency channel used. 

25 After the automated analysis of the mobile radio 
telephone system, the system quality values thus 
calculated can also be used for assessment of this 
system by a system engineer. To be able to perform the 
assessment as simply as possible, these values are 

30 preferably displayed graphically, for example as a 
histogram. In a diagram, the possible elements of the 
selected grouping criterion (e.g. all base stations) 
are plotted along the x axis and the corresponding 
system quality values are plotted along the y axis. The 

35 elements can be arbitrarily sorted in accordance with 
quality value or, for example in the case of frequency 
channels, simply in ascending or descending order of 
the channel number. Diagrams with more than two 
dimensions can also be advantageous, however. For 
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example, a three-dimensional diagram in the assessment 
of quality with regard to the geographic position as 
group criterion. Instead of displaying the individual 
measurement positions along a single axis (e.g. with 
5 the aid of a number) , two of the three dimensions of 
the diagram are simply used for displaying the 
measurement positions at their correct positions. The 
system quality values are then displayed in the third 
dimension which conveys a three-dimensional impression 
10 of the system quality in the coverage area in a simple 
manner. 

To be able to perform a more accurate system analysis, 
the system quality values are related to one another 
15 with respect to various grouping criteria. For this 
purpose, for example, the same events of a certain 
class can be grouped in accordance with different 
grouping criteria and then evaluated in accordance with 
the invention. 

20 

The external system parameters acquired are preferably 
the speech quality, the duration for establishing the 
connection, location, time, speed and direction of 
travel of the mobile station. The speech quality can be 
25 assessed in that a predetermined voice signal (e.g. a 
sentence spoken in various languages and/or with 
various voices) is transmitted and analyzed at the 
receiving end with the aid of a neuron network (compare 
e.g. EP-0 644 674 A2 ) . 

30 

The method according to the invention is performed in a 
real environment by means of an analysis arrangement in 
a conventional mobile radio telephone system. This 
comprises a public mobile radio telephone network and a 
35 plurality of terminals between which both normal 
telephone connections and test connections can be set 
up and ended again. Furthermore, at least one measuring 
device is provided by means of which the required 
protocol parameters can be acquired by measurement or 
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by recording system messages, there being typically a 
number of such measuring devices. The parameters 
acquired are forwarded to an evaluating device which 
comprises a specifically structured database and an 
5 evaluating unit. The parameters are suitably stored in 
the database and after that analyzed by the evaluating 
unit with a plurality of modules in accordance with the 
method according to the invention and from this a 
system quality value is calculated. The time of 
10 transmission of the acquired data from the measuring 
devices to the evaluating device, and of the evaluation 
of the stored data, is open. Both can be done both in 
real time and off-line at a later time. 



15 According to the invention, the evaluation of the data 
acquired can also take place separately from the data 
acquisition. For this purpose, an evaluating device is 
used by means of which data previously acquired can be 
imported. These data include, e.g., data acquired 

20 externally, i.e. measured and recorded at other 
locations, internal and/or external system protocol 
parameters of an arbitrary mobile radio telephone 
system. These data already exist as records of selected 
protocol parameters or the records are formed by the 

25 evaluating device and stored in a suitably structured 
database. The records stored in the database are 
evaluated in accordance with the invention as described 
above . 



30 To be able to perform the analysis of the mobile radio 
telephone system more and more precisely, additional 
parameters can be acquired and/or stored, new grouping 
criteria, events or event classes can be defined, other 
lead and lag times can be specified, other event 

35 vectors formed, the event-specific and/or the module 
weighting vectors can be changed or additional or, 
respectively, other evaluation graphics can be 
generated as required. Thus, the efficiency of the 
method according to the invention can be increased 
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further with time. 

Further advantageous embodiments and combinations of 
features of the invention can be obtained from the 
detailed description below and from the totality of 
patent claims - 

Brief description of the drawings 

The drawings used for explaining the exemplary 
embodiment show in: 

figure 1 a diagrammatic representation of a mobile 



figure 2 a block diagram for explaining the method 

according to the inventions- 
figure 3 a diagrammatic, graphical representation of a 

possible system analysis; 

figure 4 a diagrammatic, graphical representation of a 
further system analysis. 

In principle, identical parts are provided with 
identical reference symbols in the figures. 

Approaches to carrying out the invention 

The exemplary embodiment described in the text which 
follows can be interpreted as a multistage method: 

At the beginning, the test connections are set up and 
the protocol parameters are acquired. In addition, the 
data are entered into a relational database and grouped 
in accordance with various grouping criteria in a 
preprocessing step. 



radio telephone system and an arrangement for 
checking it; 
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In a first step, the events of interest are picked out 
of the data, classified by means of the respective 
prior and subsequent history and assessed in accordance 
with the required evaluation- The events are processed 
5 in a number of modules which in each case determine the 
system quality with respect to a particular criterion. 

In a second step, a module quality value which 
reproduces the system quality with respect to the 
10 corresponding criterion is calculated from the events 
assessed per module. 

In a third step, a measure of the entire system quality 
with regard to the selected grouping criterion is 
15 determined from the module quality values. 

In further steps, the system analysis is evaluated with 
respect to the selected grouping criterion in that the 
system quality of the corresponding groups can be 
20 graphically displayed and. thus compared with one 
another in a simple manner. 

The object of the automatic analysis according to the 
invention is a mobile radio telephone system of a type 

25 of design known per se. Figure 1 symbolically shows a 
mobile switching center 2 (MSG) and four base stations 
3.1 to 3.4 (antennas). The base stations 3.1 to 3.4 are 
controlled, e.g., by two base station controllers 
2.1, 2.2 (BSC) and supply cells 4.1 to 4.4. The mobile 

30 radio telephone system is connected, for example, to a 
public network 1 (PSTN) . Thus, calls can be made in the 
usual manner between a stationary terminal 5.1 or a 
mobile terminal 5.2, respectively, and a mobile station 
6. 

35 

As a rule, it is very difficult to systematically 
measure and assess the quality of a mobile radio 
telephone system. Due to the fact that the mobile 
station is continuously moving, the state of the mobile 
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radio telephone system is also changing- This takes 



cases (e.g. during a handover due to a change to 
another base station) . 



On the market^ specific measuring devices are already 
available which allow calls to be set up automatically 
and the quality of the connection to be measured 
(compare e.g. Ascom Infrasys AG, CH-4503 Solothurn, 

10 Switzerland "ascom Qvoice, The Most Advanced Cellular 
Network Quality Measurement System") . Although these 
known measuring systems acquire a large volume of data, 
they do not, however, provide the operator with a 
possibility for automated analysis and quality 

15 assessment. 

The method according to the invention goes one step 
further in this case. The essential steps will be 
explained in greater detail with reference to figures 1 
20 and 2. 

As part of a test phase, a large number of test 
connections are set up in succession and alternately 
between a stationary unit 9.1 (which comprises a first 

25 measuring device 7.1 and a conventional circuit of a 
terminal 5.1) and a mobile station 6 (which contains a 
second measuring device 7.3 with a mobile radio 
telephone circuit 5.3) or between a mobile unit 9.2 
(which comprises a third measuring device 7.2 and a 

30 conventional circuit of a mobile terminal 5.2) and the 
mobile station 6. In real terms, this means that, e.g., 
the mobile station 6 dials the number of the terminal 

5.1 or 5.2, a check is made whether the connection has 
been set up and after what time, that the speech 

35 quality is measured and that, finally, the call is 
correctly terminated- The procedure is also carried out 
in the reverse direction, i.e. from unit 9.1 or unit 

9.2 to the mobile station 6. Several hundred 
connections are preferably set up, dropped and measured 



place, however, not continuously but abruptly in some 
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by the measuring devices 7.1 to 7.3, for example. 
During this process, the mobile station is driven all 
over the area of the mobile radio telephone system to 
be tested. 

5 

Each of these calls is logged. I.e., all internal 
states of the mobile radio telephone system are stored, 
if possible, on the one hand and, on the other hand, 
various external system parameters are also acquired. 
10 The states of the mobile radio telephone system are 
determined by internal system protocol parameters. 
These parameters exist in every mobile radio telephone 
system (compare GSM Recommendation 04.08). Examples of 
these are: 

15 

• Radio channel parameter (frequency, signal level 
etc.) 

• Call control parameters 

• Mobility management parameters (routing, handover 
20 parameters etc.) 

It is not only the protocol parameters occurring in the 
terminals (e.g. GSM protocols of various layers) which 
are acquired but also those generated within the 
25 system, e.g. the protocols running in the base stations 
or controllers, respectively. 

External system protocol parameters are those which are 
not generated by the mobile radio telephone system 
30 itself such as, e.g.: 



• Coordination parameters (location, time, speed, 
direction etc. of the mobile station), 

• Quality parameters (duration of the call set-up, 
35 unsuccessful call set-up, quality of the speech 

signals transmitted during the call, particular 
disturbances etc.), 

• Control information (e.g. time of the signal which 
causes the terminal to dial a particular connection) . 
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It must be noted that protocol parameters are always 
related to an instantaneous operating state. They can 
change their values in part during a call or from one 
5 call to the next. 



From the protocol parameters mentioned, records related 
to the individual functional units are generated and 
provided with a time stamp. During the test phase, the 

10 records can be stored, for example locally, in the 
order in which they are generated. However , it is also 
possible to transmit the records directly to a 
processing station 10 where they are entered in a 
database 11 and are correlated with one another. For 

15 this purpose, various tables which list the data blocks 
or records in accordance with predetermined grouping 
criteria are generated in a preprocessing step. Thus, 
the records can be listed, for example in chronological 
order (with additional specification of the type of 

20 data, the identification number of the call etc.). 
Advantageously, a number of lists are provided in 
accordance with the search functions to be applied 
later- For example, the data blocks can be sorted in 
accordance with the geographic location of the mobile 

25 station. 



Next, the parameter values stored in the database 11 
are processed and analyzed in the processing unit 8. 
This is done in various modules 12.1 to 12.3. Each 
30 module 12.1 to 12.3 evaluates the data with regard to a 
certain assessment criterion. Examples of these are: 



• Call End, 

• Speech Quality, 
35 • Coverage, . 

• Timing, 

• Handover, 

• Data Service. 
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For this purpose, a plurality of event tables 13.1 to 
13.9 are generated by searching in the presorted lists 
for certain events relevant to the respective 
assessment criterion. These events are identified by 
5 searching for certain individual or particular 
combinations of protocol parameter values and storing 
the corresponding records in the event tables 13.1 to 
13.9. 

10 Such an event is, e.g., a connection release, regular 
or premature. A connection release can be detected, 
e.g., with the aid of the internal system protocol 
parameters. In a mobile radio telephone system there 
are flags which provide information in this . regard. 

15 However, there are also external system protocol 
parameters which make it possible to detect a 
connection release (e.g. corresponding or missing 
response signals from the other subscriber station) . 

20 A handover can also be called an event, for example. 

In the combined search, the object is in most cases 
unusual combinations of parameter values which may 
point to a weakness in the system performance (e.g. a 
25 high signal level in combination with a high bit error 
rate) . 

In the next step, the accurate time at which it has 
taken place is determined for each event found. After 

30 that, further events which may be of significance for 
the event found, e.g. can influence it or can be 
influenced by it, are searched for within a particular 
leading and trailing time. Relevant data of these 
events, too, are stored in the event tables 13.1 to 

35 13.9. 



Using the stored data, e.g. the order and the parameter 
values of the events within the leading and trailing 
t.ime of a particular event, the latter is ithen 
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classified/ i.e. allocated to one of several possible 
types of event. This provides a number of event types 
which in each case have occurred more or less 
frequently within the observation interval. 

5 

With regard to the grouping criterion selected or to be 
evaluated, respectively, there is for each of these 
event types a certain selection of relevant protocol 
parameters and a certain event weighting vector 15.1 to 
10 15.9 by means of which a more or less great 
significance can be given to the individual parameter 
values . 

The mean value of each protocol parameter of this 
15 selection is then formed so that, at the end, the 
result is exactly one average record 14.1 to 14.9 per 
event type. Each value of this average record 14.1 to 
14.9 is thus equal to the average of all corresponding 
values of the event records of a particular event type. 

20 

The further processing in the individual modules 12.1 
to 12.3 is performed by formation of a vector from the 
average records 14.1 to 14.9 and scalar multiplication 
by the corresponding event weighting vector 15.1 to 
25 15-9. The result is one event quality value 16.1 to 
16.9 each per event type examined. 

Finally, to determine the module quality value 17.1 to 
17.3 of the individual modules, the mean value of all 
30 event quality values 16.1 to 16.3 for module 12.1, 16.4 
to 16.6 for module 12.2 and 16.7 to 16.9 for module 
12.3, calculated in this module, is simply calculated. 

Lastly, the system quality value 20 is calculated. For 
35 this purpose, a module quality vector 18 is formed from 
the individual module quality values 17.1 to 17.3 and 
is then subjected to a scalar multiplication by a 
module weighting vector 19. 
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Instead of calculating the average records 14.1 to 14.9 
or, respectively, the module quality values 17.1 to 
17.3 as mean values of the individual event records or, 
respectively, the event quality values 16.1 to 16.9 in 
5 each case, these could naturally also be calculated as 
a weighted sum (similarly to the scalar product in the 
calculation of the event quality values 16.1 to 16.9 
and of the system quality value 20) and the sum of the 
respective weighting factors could also be selected 
10 equal to one in each case. 

In the text which follows, greatly simplified examples 
will illustrate the above general statements. It is 
assumed in each case that the phase of data acquisition 

15 and the preprocessing is already concluded. Thus, the 
data must be analyzed and represented in the required 
manner so that a system engineer can interpret them in 
a simple manner. In addition, he should be able to 
refine his analysis until he has reached the required 

20 depth of detail. 

The mobile radio telephone system is analyzed 
automatically after the system engineer has told the 
system (e.g. by selecting a menu point on a computer 

25 screen) which evaluation, i.e. which quality values 
with respect to which grouping criteria and with which 
weighting vectors, he would like to see. The system 
first determines the weighting factors corresponding to 
the evaluation, then performs the analysis 

30 automatically and displays the required evaluation 
graphically on the screen. 

Figure 3 shows, for example, a (hypothetically assumed) 
frequency distribution of the system quality values 
35 with respect to the grouping criterion network 
operator. For each network operator NBl to NB5, a 
column is shown the height of which corresponds to the 
system quality value of this network operator NBl to 
NB5 . The values are ordered in accordance with the 
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number of network operator NBl to NB5 . 

It must be noted that the frequency distribution shown 
is only one of an enormous number of possible frequency 
5 distributions with respect to this grouping criterion. 
Depending on the choice of weighting factors of the 
event weighting vectors or of the module weighting 
vector, very detailed information can be extracted from 
the database 11. In the text which follows, three 

10 examples of this are given. In each example, the data 
from the first module 12.1 with respect to the 
assessment criterion call end, from the second module 
12.2 with respect to speech quality and from the third 
module 12.3 with respect to coverage are evaluated. The 

15 protocol parameters taken into consideration and their 
sequences with respect to call end are assumed to be, 
e.g., signal level, bit error rate, radio channel and 
handover . 

20 First example: both the weights of the event weighting 
vectors 15.1 to 15.9 and those of the module weighting 
vector 19 are all greater than zero. In this case, the 
frequency distribution of figure 3 shows a comparison 
of the qualities of the overall mobile radio telephone 

25 systems of the individual network operators NBl to NB5 . 



Second example: the weights of the event weighting 
vectors 15.1 to 15.9 are all greater than zero but the 
weights of the module weighting vector 19 are all zero 
30 except that for the call end module 12.1. The frequency 
distribution of figure 3 shows in this case an overall 
comparison of the qualities of all call ends of the 
individual network operators NBl to NB5 . 

35 Third example: all weights of the event weighting 
vectors 15.1 to 15.9 are equal to zero except that for 
the signal level. All weights except that for the call 
end module 12.1 of the module weighting vector 19 are 
also equal to zero. The frequency distribution of 
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figure 3 shows a detailed comparison of the quality of 
all call ends of the individual network operators NBl 
to NB5 which are attributable to too low a signal level 
in this case. 



It is clear that an immense amount of evaluations are 
possible due to the plethora of conceivable weighting 
vectors. It is also possible, therefore, to have the 
assessment of a mobile radio telephone system performed 

10 automatically by an evaluating unit (not shown) and not 
to leave this to a system engineer by means of the 
graphical representations. The evaluating unit can 
send, for example, correction messages to the 
functional units affected or display a list of faults 

15 found via an output unit to the system engineer. He can 
then take the required measures (e.g. replace a 
defective control circuit or load correct configuration 
data or a correct program) . It is also possible for the 
system engineer initially to act independently during 

20 the analysis and then to be supported by the system in 
the refinement and error localization . 

Figure 4 shows another frequency distribution (also 
hypothetically assumed) of the system quality values 

25 with respect to the grouping criterion base station. 
For each base station BSl to BS13, one column is shown 
the height of which corresponds to the system quality 
value of this base station BSl to BS13. However, the 
values are not ordered in accordance with the number of 

30 the base station BSl to BS13 but in accordance with the 
respective system quality value. This makes it possible 
to see at a glance the distribution of the quality 
values corresponding to the required evaluation, what 
the general quality level looks like and where 

35 improvements are urgently necessary. 
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possible in accordance with the selected weighting 
vectors . 

The examples chosen were deliberately very simple. 
However, it can be easily seen that the method is quite 
generally suitable for an analysis and assessment of a 
mobile radio telephone system of any required detail 
and thus for uncovering fault causes and for automated 
locating of system defects. 



In summary it must be stated that the method according 
to the invention and the corresponding arrangement make 
it possible to analyze a mobile radio telephone system 
and to assess its quality so that it can be selectively 
15 improved. 

The invention has the following advantages: 

• In principle, the method is programmable and 
20 expandable. It can grow with increasing level of 

knowledge of the system provider. It is also possible 
to include new findings of the network operator. 

• System analysis and any subsequent fault finding and 
25 elimination of causes is very rapid. For each hour of 

a test run, the analysis time is within the range of 
seconds (and not of hours) . 

• It is possible to assess the quality of an entire 
30 system or of any part thereof. 

• However, it is also possible to find individual 
problems in individual connections even with a very 
large volume of data and a very low error rate of the 

35 system. 



All problems known to the experts are rapidly 
identified. New problems which have never occurred 
before can be detected and selectively examined manually. 



